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ABSTRACT 


The  first  major  experimental  comparison  of  approval  voting  with  regular 
plurality  voting  occurred  in  the  1985  annual  election  of  The  Institute  of 
Management  Sciences  (TIMS).  In  approval  voting  a  person  votes  for  (approves  of) 
as  many  candidates  as  desired,  the  winner  being  the  candidate  with  the  most  votes. 
By  permitting  more  votes  than  the  number  of  postions  to  be  filled,  approval  voting 
collects  more  information  from  the  voter  than  does  plurality  voting.  This  can  make 
a  difference,  for  example,  when  three  candidates  compete  for  a  single  office.  In 
such  situations  two  candidates  with  wide  but  similar  appeal  sometimes  split  a 
majority  constituency  so  that  a  minority  candidate  is  elected  under  plurality  voting. 
Approval  voting,  by  contrast,  is  likely  to  identify  the  candidate  who  is  most  broadly 
acceptable  to  the  electorate  as  a  whole. 

In  the  TIMS  experiment  society  members  received  an  experimental  approval 
ballot  along  with  their  official  plurality  ballot.  Two  contests  involved  three 
candidates  running  for  a  single  office  and  a  third,  five  candidates  for  two  positions. 
Surprisingly,  in  two  of  the  three  contests,  approval  voting  would  have  produced 
different  winners  and  neither  of  the  changes  was  of  the  type  usually  emphasized  in 
the  approval  voting  literature. 

The  experiment  demonstrated  the  feasibility  of  approval  voting  and  showed 
that  it  can  make  a  difference.  Direct  comparison  of  ballots  makes  it  possible  to 
determine  why  the  experimental  switches  occurred.  It  is  shown  that  in  each 
reversal  the  approval  winner  had  broader  support  in  the  electorate  than  the 
plurality  winner.  The  experiment  also  provided  empirical  data  on  how  voters 
distribute  approvals  across  candidates  and  indicates  that  their  behavior  was  roughly, 
but  not  exactly,  consistent  with  theoretical  analyses  of  voting  efficacy. 


1.    INTRODUCTION 

A  major  experiment  to  compare  approval  voting  with  regular  plurality  voting 
took  place  during  the  annual  election  of  The  Institute  of  Management  Sciences 
(TIMS)  in  1985.  Most  of  the  voters  filled  out  an  experimental  approval  ballot  along 
with  an  official  plurality  ballot,  thereby  permitting  a  detailed,  side-by-side 
examination  of  the  two  methods.  The  election  involved  1800  voters  in  three 
multicandidate  elections,  which  makes  it  by  far  the  largest  field  test  of  approval 
voting  to  date.  This  paper  describes  the  experiment,  analyzes  its  results,  finds 
unexpected  phenomena,  and  shows  that,  under  several  quite  different  circumstances, 
approval  voting  provides  winners  that  have  broader  electorate  support  than  does 
plurality  voting. 

Approval  voting  differs  from  familiar  plurality  voting  by  allowing  each  voter 
to  vote  for  any  number  of  candidates.  Each  vote  is  a  full  vote  so  that,  if  n  people 
are  to  be  elected,  the  n  candidates  with  the  most  votes  win.  Plurality  voting  is 
similar  except  that  each  voter  votes  for  at  most  n  candidates.  With  two  candidates 
running  for  one  office,  a  voter  normally  marks  the  ballot  for  one  or  the  other  and 
so  both  methods  give  the  same  result.  However,  with  three  candidates  running  for 
the  same  office,  under  approval  voting  a  voter  may  mark  one,  two,  or  three 
candidates.  Marking  one  would  be  similar  to  ordinary  plurality  voting,  marking  two 
would  indicate  approval  of  two  candidates  relative  to  the  third,  and  marking  all 
three  would  have  the  same  effect  as  not  voting,  although  the  voter  could  use  such 
a  mechanism  to  indicate  approval  of  all  candidates.  In  such  multicandidate 
elections,  having  two  or  more  candidates  beyond  the  number  of  positions  to  be 
filled,  the  two  methods  may  well  produce  different  outcomes. 


Approval  voting  may  be  viewed  as  an  extension  of  plurality  voting  that 
allows  voters  to  express  their  preferences  more  fully  in  multicandidate  elections  and 
and  so  provides  a  more  complete  measurement  of  electorate  support  for  each 
candidate.  The  method  was  proposed  independently  by  several  people  about  a 
decade  ago  (Ottewell  1977,  Kellett  and  Mott  1977,  Weber  1977,  Brams  and  Fishburn 
1978,  Morin  1980).  Since  then  it  has  been  explained  and  analyzed  by  many 
investigators,  including  Mueller  (1979),  Kim  and  Roush  (1980),  Straffin  (1980),  Riker 
(1982),  Brams  and  Fishburn  (1983)  and  Merrill  and  Nagel  (1985).  It  has  aroused 
controversy  (Riker  1982,  Arrington  and  Brenner  1984,  Niemi  1984,  Nicmi  and  Bartels 
1984,  Brams  and  Fishburn  1984,  1985)  with  respect  to  its  possible  effects  on  two- 
party  systems  and  the  extent  to  which  is  might  be  vulnerable  to  strategic  voting. 

Certain  questions  about  the  new  method  can  be  addressed  by  theoretical 
analysis,  but  others  cannot.  Therefore  a  major  concern  about  approval  voting  as  a 
practical  method  is  its  performance  relative  to  existing  procedures  in  actual 
elections.  Some  insight  can  be  obtained  by  examining  data  from  past  elections  to 
assess  the  probable  effects  on  the  outcomes  had  approval  voting  been  used  (Brams 
and  Fishburn  1983,  Coombs,  Cohen  and  Chamberlin  1984).  Such  studies  suggest  that 
approval  voting  is  superior  to  existing  procedures  with  respect  lo  fairness  to  voters 
and  candidates  in  terms  of  actually  reflecting  the  candidates'  support  within  the 
electorate,  and  the  likelihood  of  electing  majority  candidates  when  they  exisit. 
(Majority  candidates  are  ones  who  would  defeat  all  others  in  simple-majority 
pairwise  contests.)  For  example,  each  of  the  1970  and  1980  New  York  Senatorial 
elections  had  three  main  candidates  on  the  ballot.  Although  each  election  had  a 
majority  candidate,  the  majority  candidates  lost  the  plurality  elections  because  some 


of  their  support  was  diverted  to  similar  candidates  under  the  votc-for-one  rule, 
thereby  permitting  minority  candidates  to  win.  If  approval  had  been  used,  the 
majority  candidates  would  have  won. 

Suggestive  as  these  historical  analyses  arc,  they  invariably  require 
assumptions  about  how  voters  would  behave  under  different  circumstances  from 
those  actually  obtaining  and  therefore  do  not  provide  the  same  force  of  evidence  or 
permit  the  same  depth  of  analysis  that  is  enabled  when  voters  fill  in  two  alternative 
ballots  for  the  same  set  of  candidates.  Nor  can  retrospective  studies  respond  to  the 
criticism  that  approval  voting  is  too  difficult  to  implement.  Finally,  if  approval 
voting  is  so  good,  will  anyone  try  it? 

A  field  test  can  therefore  help  answer  the  following  questions: 

(1)  Docs  approval  voting  make  a  difference?  It  is  relatively  easy  to 
pick  out  extreme  examples  in  historical  elections  where  outcome  reversals  would 
almost  certainly  have  occurred,  but  one  would  like  to  develop  a  body  of  experience 
with  more  ordinary  multicandidatc  elections.  Futhermorc,  although  in  retrospective 
studies  we  can  sometimes  infer  preferences,  albeit  imperfectly,  this  does  not  tell  us 
how  voters  would  actually  mark  a  multi-choice  approval  ballot. 

(2)  When  approval  voting  makes  a  difference,  what  causes  the  change? 
By  having  two  ballots  from  each  voter,  we  can  observe  actual  behavior  and  find  out 
not  only  which  candidates  are  drawing  from  which  others,  but  also  how  much 
overall  second  choice  approval  is  generated  and  how  it  will  affect  close  races. 

(3)  Is  approval  voting  feasible?  Some  people  have  suggested  that  it 
would  be  difficult  for  the  voters  to  understand  and  carry  out. 

(4)  Will     voters    behave    effectively?       Theory    suggests    that    certain 


voting  strategies   would   be   most  efficacious  for   the  voters,  but   will   they  vote  this 
way  in  practice? 

The  first  field  comparison  of  approval  and  plurality  voting  that  we  know 
about  occurred  at  the  University  of  Haifa  in  1984  for  elections  to  its  faculty  senate. 
Voters  were  asked  to  submit  an  experimental  ballot  along  with  their  regular 
plurality  ballot  and  to  rank-order  the  candidates.  Only  a  few  dozen  voters  were 
involved.  The  results,  analyzed  in  Felsenthal,  Maoz  and  Rapoport  (1985),  indicate 
that  approval  voting  worked  well  in  the  election  studied. 

The  TIMS  experiment  was  on  a  far  larger  scale.  It  was  patterned  in  part  on 
the  Haifa  test  in  its  use  of  two  ballots  and  a  ranking  of  candidates.  However, 
unlike  the  Haifa  elections,  which  had  open-ended  nominations,  only  a  few  candidates 
competed  for  each  TIMS  office  and  the  number  of  voters  was  several  orders  of 
magnitude  larger  than  the  number  of  candidates.  The  TIMS  case  is  much  more  like 
elections  to  public  and  private  office  as  most  people  ordinarily  think  about  them. 

In  discussing  the  results  of  the  analysis  as  it  proceeds,  we  shall  assume  that 
it  is  desirable  to  elect  the  candidates  most  wanted  by  the  electorate  as  a  whole, 
and  we  shall  evaluate  approval  voting  for  its  ability  to  do  that.  In  particular,  we 
shall  assume  that  majority  candidates  are  good,  because  they  can  defeat  all  other 
candidates  in  one-on-one  runoffs.  In  the  absence  of  a  majority  candidate  other 
measures  of  overall  electorate  preference  will  be  examined.  We  save  to  the  end  of 
the  paper  a  wider  discussion  of  criteria  for  judging  voting  systems. 

The    next    section    of    the    paper    summarizes    the    experimental    design    and 


provides  overall  statistics  on  the  balloting.  Subsequent  sections  analyze  the  three 
individual  elections  and  a  final  one  discusses  the  findings.  Additional  supporting 
data  appear  in  an  appendix. 


2.    THE  TIMS  EXPERIMENT 

TIMS  by-laws  require  that  all  offices  be  contested  and,  usually,  exactly  two 
candidates  are  nominated  for  each  position.  To  create  elections  in  which  approval 
voting  might  be  expected  to  make  a  difference,  the  nominating  committee 
deliberately  increased  the  number  of  candidates  in  three  of  the  elections.  In  two, 
one  person  was  to  be  elected  from  three  candidates;  in  the  third,  two  from  five. 
All  of  the  candidates  were  informed  of  the  test  and  agreed  to  participate.  To 
preserve  a  degree  of  anonymity,  the  elections  will  not  be  identified  by  office  and 
the  candidates  will  be  designated  A,  B,  C,  .  .  .  etc. 

The  experiment  was  announced  in  the  society's  newsletter  in  February 
1985  and,  in  April,  two  ballots  were  mailed  to  each  member.  An  official  plurality 
ballot  determined  the  binding  results  of  the  election  and  an  experimental  ballot 
assessed  the  effects  of  approval  voting  in  the  three  races  that  had  at  least  three 
candidates.     We  shall  designate  the  three  elections  as: 


El 
E2 
E3 


an  election  of  one  out  of  three  candidates; 

another  election  of  one  out  of  three; 

an  election  of  two  out  of  five  candidates. 


In   these  elections  each  voter  was  asked   to  check  approved  candidates  to 
the    right    of    the    names   on    the   experimental   ballot   and,   in   addition,    to   rank    the 
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candidates  (1,  2,  .  .  .)  at  the  left  of  the  names.  Although  rankings  are  not  part  of 
approval  voting,  they  assist  majority  comparisons.  Since  majority  candidates  (which 
might  not  exist  if  there  are  cyclical  majorities)  are  often  believed  to  be  most 
desirable,  the  experiment  was  designed  to  include  this  information. 

1,851  members  returned  the  official  ballot.  Of  these,  1,579  (85%)  also 
returned  the  test  ballot.  This  remarkably  high  rate  of  return  shows  widespread 
cooperation  by  the  members  and  lends  credence  to  the  results.  Further  support 
arises  in  the  exceptionally  small  number  of  inconsistencies,  which  run  to  single  digit 
numbers  in  any  given  contest.    (The  Appendix  provides  further  details.) 

Almost  all  the  test  ballots  had  some  approvals  checked,  but  a  few  did  not 
rank  the  candidates.    The  counts  by  response  category  were: 


Rl.    Only  official  ballot  returned:  272    (14.7%) 

R2.    Test  ballot  also  returned,  but  without  rankings:  68    (  3.7%) 

R3.    Test  ballot  also  returned  with  some  rankings:  1511    (81.6%) 


1851 


Slightly  different  numbers  of  voters  participated  in  each  election. 


3.    ELECTION  El 

El     was    a    three-way    race    among    candidates    A,    B,    and    C,    in    which 
approval  voting  would  have  changed  the  winner  from  C  to  B.    As  may  be  seen  in 


official 

plurality 

vote 

A 

166 

B 

827 

C 

835** 

** 


1828 


largest  vote 


actual 

extrapolated 

approval 

approval 

vote 

vote 

417 

486 

1038** 

1224** 

908 

1054 

2363 

2764 

(1567  voters) 

(1828  voters) 

Table    1:      Official   and    approval    votes   for   election    El    show    that    C   won    the 
official  election  but  B  would  have  won  under  approval  voting. 


Table  1,  candidate  C  won  the  official  election  by  8  votes  (0.4%  of  the  votes  cast) 
but,  had  approval  voting  been  in  effect,  B  would  have  won  by  130  (5.5%  of  the 
votes  cast)  using  the  actual  returned  votes.  B  would  have  won  by  170  (6.1%)  in 
extrapolated  totals. 

3.1      Construction  of  extrapolated  totals. 

Because  some  voters  who  submitted  an  official  ballot  did  not  return  the  test 
ballot,  we  show  a  set  of  extrapolated  totals  that  include  an  estimated  approval  vote 
from  this  group.  This  is  done  by  assuming  that  the  non-responders  would  have 
behaved  in  the  manner  of  those  who  responded  to  both  ballots.    Let 

Nx  =  number  of  non-responders  who  voted  for  candidate  X  on  the 

official  ballot; 
P(Y/X)     =  fraction  of  rcsponders  approving  candidate  Y  given  that 

they  voted  for  X  on  the  offical  ballot. 
Then  our  estimate  of  additional  approval  votes  attributable  to  non-  respondcrs  is: 
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added  approval  votes  for  Y  =  P(Y/A)Na+P(Y/B)Nb+P(Y/C)Nc. 

We    see    from    Table    1    that    the    extrapolation    does    not    change    the    results    in    any 
fundamental  way. 

3.2      Search  for  a  majority  candidate. 

Next  we  look  for  a  majority  candidate.  As  stated  earlier,  a  majority 
candidate  is  one  who  would  win  in  pairwise  (plurality)  elections  with  all  other 
candidates.  The  analysis  here  is  a  little  more  complicated  and  makes  use  of  the 
rankings.    Table  2  presents  the  results. 


Contest:  A  vs.  B 

Inferred  votes  for:  A  B 


A  vs.  C 
A  C 


B  vs.  C 
B  C 


Revealed  first 
choices  from 
official  ballot 
counts: 

Revealed  second 
choices  from: 
R3  rankings 
R2  approvals 

Subtotal  of 
revealed  choices: 

Estimated  second 
choices: 

Extrapolated 
total  votes: 


166     827 


166    492 
2         3 


334  1322 


44     128 


378  1450** 


166     835 


290     331 
4         9 


460  1175 


89     104 


549  1279** 


827     835 


70       66 
3         0 


900    901 


14       13 


914     914 


**  larger  vote 

Table  2.     For  election  El,  majority  comparisons  show  that  in  hypothetical  two-way 
races  both  B  and  C  would  defeat  A  but  that  B  against  C  would  be  a  virtual  tie. 


The  totals  show  that  both  B  and  C  would  beat  A,  but  that  B  and  C  are 
essentially  in  a  dead  heat.  The  analysis  that  leads  to  these  results  will  be 
illustrated  with  the  B  versus  C  comparison.  827  voted  for  B  on  the  official  ballot 
and  are  listed  in  the  first  row  as  preferring  B  to  C  (and  also  B  to  A).  Similarly 
835  prefer  C  to  B.  However,  166  people  cast  votes  for  A.  How  would  they  vote  in 
a  B  versus  C  election?    The  ballots  of  these  166  show  that 


70  provided  rankings  in  the  order  ABC, 
66  provided  rankings  ACB, 

3  provided  no  rankings  but  approved  A  and  B, 
27  made  no  distinction  between  B  and  C  by  ranking  or  approvals. 


Thus   in   a   B  versus  C  comparison   the   70  are   credited   to  B,  the  66  to  C,  and   the   3 
to  B. 

This  leaves  27  who  voted  for  A  but  gave  no  indication  of  a  B  versus  C 
preference.  If  the  27  are  ignored,  the  revealed  choices  arc  900  for  B  and  901  for 
C.  The  next  to  last  row  of  Table  2  estimates  how  the  27  would  split  between  B 
and  C  if  they  adhered  to  the  pattern  of  the  139  voters  (70+66+3)  who  voted  for  A 
and  also  expressed  a  preference  between  B  and  C.  The  calculation  for  B  is 
27(73/139)=14.2  and  for  C  is  27(66/139)=12.8.  The  final  totals,  rounded  to  the 
nearest  vote,  are  914  for  each.  No  valid  distinction  between  the  two  candidates  is 
possible. 

3.3      Discussion. 

To   summarize,    candidate   C   wins   the   official    plurality   election    by   a    hair, 
0.5%,  but  B  would  have  won  an  approval  vote  by  6.1%  and  a  head-to-head  election 
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would  be  too  close  to  call.  The  picture  emerges  that  C  has  a  loyal  following  that 
is  just  a  little  larger  than  B's.  However,  among  A's  followers,  more  approve  of  B 
than  C  (36%  to  23%).  Furthermore  more  of  C's  followers  approve  of  B  than  B's 
followers  do  of  C.    Hence  B  wins  the  most  approval  votes. 

What  can  we  conclude?  Approval  voting  is  usually  praised  because  it  will 
often  elect  a  majority  candidate  when  a  split  block  of  votes  would  cause  the 
candidate  to  lose.  This  is  not  really  the  case  here.  We  do  not  have  a  clear 
majority  candidate  because  of  an  effective  tie.  However,  approval  voting  picks  a 
clear  winner  on  the  basis  of  second  choices.  These  show  that  B  has  a  broader 
acceptance  in  the  electorate  than  C.  Therefore,  the  approval  process,  by  eliciting 
more  information  from  the  voters,  leads  to  the  election  of  the  candidate  with  the 
widest  support. 

We  should  also  point  out  that,  although  it  did  not  happen  here,  it  would  be 
possible  for  C  to  have  actually  been  a  majority  candidate  by  a  few  votes  and  then 
lose  by  the  approval  voting  criterion  because  B  received  enough  second  choice 
approvals  to  become  the  winner.  This  could  only  happen  for  two  close  candidates, 
but  does  demonstrate  that  the  criteria  of  "majority  candidate"  and  "most  approval 
votes"  are  not  identical.  On  the  other  hand,  as  seems  clear  from  the  experiment  as 
well  as  from  various  theoretical  analyses,  approval  voting  will  much  more  often 
bring  forward  majority  candidates  than  plurality  voting.  In  experimental  election  El 
where  there  is  no  clear  majority  candidate,  approval  voting  demonstrates  its  ability 
to  be  a  tie-breaker  in  favor  of  the  more  broadly  supported  candidate. 
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4.    ELECTION  E2 

Election    E2    is    another    three-way    race    to    elect    one    person,    but    here 
plurality  and  approval  results  agree.     Table  3  presents  the  results. 


official 

actual 

extrapolated 

plurality 

approval 

approval 

vote 

vote 

vote 

A 

386 

558 

635 

Candidate 

B 

551 

713 

801 

C 

599** 

768** 

871** 

1536 

2039 
(1354  voters) 

2307 
(1536  voters) 

**  largest  vote 
Table  3.    In  election  E2  plurality  and  approval  votes  pick  the  same  winner. 


Table  3  also  demonstrates  an  attractive  feature  of  approval  voting  for 
three-candidate  contests  in  which  all  candidates  make  good  showings.  The  winning 
plurality  is  38.7%,  well  below  50%,  whereas  the  largest  approval  count  is  56.7%, 
comfortably  over  50%  of  the  voters.  Hence  even  though  C  won  with  only  a  39% 
plurality,  C  was  approved  of  by  a  majority  of  the  voters. 

In  a  surprise,  even  though  candidate  C  wins  both  plurality  and  approval 
votes,  C  is  not  a  clear  majority  candidate.  As  seen  in  Table  4,  C  defeats  A  (as 
docs  B)  in  a  pairwise  race,  but  C  and  B  are  in  a  virtual  tie  when  run  against  each 
other.  Such  a  closeness  would  not  have  been  anticipated  from  Table  3  and  arises 
because  A's  supporters  tend  to  prefer  B  to  C  (56%  to  44%). 
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Contest:  A  vs.  B 

Inferred  votes  for:  A        B 


A  vs.  C 
A       C 


B  vs.  C 
B        C 


Revealed  first 
choices  from 
official  ballot 
counts: 

Revealed  second 
choices  from: 
R3  rankings 
R2  approvals 


395 


171 
1 


552 


281 
3 


Extrapolated 
total  votes: 


395         597 


179         240 
2  1 


620         924** 
**  larger  vote 


632         91 


->** 


552         597 


162         128 
0  1 


Subtotal  of 

revealed  choices 

567 

836 

576 

838 

714 

726 

Estimated  second 

choices: 

53 

88 

56 

74 

58 

46 

772         772 


Table  4.  For  election  E2,  C  is  not  quite  a  majority  candidate:  in  hypothetical 
two-way  races  B  would  defeat  A,  C  would  defeat  A,  but  C  versus  B  is  too  close  to 
call. 


To  summarize,  election  E2  presents  an  example  in  which  the  plurality  and 
approval  votes  agree  on  C.  Suprisingly,  C  is  not  a  clear  majority  candidate  because 
we  cannot  prove  that  C  would  beat  B  in  a  two-way  race.  The  results  drawn  from 
the  rankings  data  are  too  close.  From  the  point  of  view  of  plurality  voting,  C  wins 
because  A  is  a  spoiler  who  takes  enough  votes  away  from  B  to  let  C  carry  the  day. 
C's  victory  in  approval  voting  has  a  different  basis,  one  that  seems  better  by  our 
criterion  of  broadest  support:  C  is  more  favored  as  an  acceptable  second  choice 
among  the  population  as  a  whole.  Thus,  as  in  election  El,  approval  voting  is  a  tie- 
breaker that  selects  the  candidate  with  the  widest  support. 
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5.    ELECTION  E3 

A  new  surprise  awaits  us  in  election  E3,  in  which  two  people  are  to  be 
elected  from  among  5  candidates,  A,  B,  C,  D  and  E.  We  find  that  the  second  place 
winner  in  the  official  plurality  election  finishes  fourth  in  the  approval  voting. 
Table  5  shows  the  summary.  (The  extrapolated  approval  vote  shows  the  same 
pattern  as  the  actual  vote  and  is  omitted.) 


official 

plurality 

vote 

A 

679* 

Candidate                B 

937** 

C 

651 

D 

670 

E 

391 

3328 

(1749  voters) 

**  largest 

vote 

*    second  largest  vote 

actual 

approval 

vote 

669 

956** 

715* 

685 

483 


3508 
(1380  voters) 


Table  5.  In  election  E3  with  two  positions  to  be  filled,  the  first  choice  is  the 
same  under  both  methods  but  the  second  choice  by  plurality  voting  drops  to  fourth 
place  in  approval  voting. 


The  majority  comparisons  of  hypothetical  pairwise  contests  between  the 
candidates  appear  in  Table  6.  Unlike  elections  El  and  E2,  E3  has  a  clear  majority 
winner,  B,  who  could  defeat  any  other  candidate  in  a  one-on-one  plurality  election. 
Furthermore,  there  is  a  majority  runner-up,  C,  who  could  do  the  same  with 
everyone  except  B.    In  fact.  Table  6  and  Figure  1  show  that  the  majority 
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Votes         Revealed  first  Other  revealed    Revealed  choices 

inferred      choices  from              choices  from  from  approval 

Contest    for               rankings                        rankings  ballots  Totals 

203  10  550 

376  25  844* 

312  16  665 

420  22  708* 

303  12  652 

393  21  673* 

398  15  750* 

394  10  507 

392  19  854** 

234  13  513 

389  22  854** 

260  17  536 

537  26  1006** 

250  6  359 

420  15  701** 

348  17  624 

535  22  823** 

364  9  476 

520  24  803** 

375  9  487 

**  larger  vote  of  pair 

Table  6.  Results  of  hypothetical  pairwise  contests  between  the  five  candidates 
in  E3  show  that  approval  winners  B  and  C  would  win  pairwise  contests  with  all 
others. 


A  vs  B 

A 

337 

B 

443 

A  vs  C 

A 

337 

C 

266 

A  vs  D 

A 

337 

D 

259 

A  vs  E 

A 

337 

E 

103 

B  vs  C 

B 

443 

C 

266 

B  vs  D 

B 

443 

D 

259 

B  vs  E 

B 

443 

E 

103 

C  vs  D 

C 

266 

D 

259 

C  vs  E 

C 

266 

E 

103 

D  vs  E 

D 

259 

E 

103 
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Figure  1.  A  graph  of  the  hypothetical  pairwise  contests  within  E3  with  arrows 
toward  the  winners  shows  that  B,  then  C,  are  the  two  elected.  Since  there  are  no 
directed  cycles,  no  cyclical  majorites  are  present. 


comparisons   for   E3   are   transitive   with   ranking   B   C   D   A   E.     Rankings   from   three 
types  of  analysis  are: 


plurality: 
approval: 
majority: 


BADGE 
B  C  D  A  E 
B  C  D  A  E. 


Thus  approval  voting  has  faithfully  reproduced  the  majority  rankings,  but  plurality 
voting  has  not.  Instead,  as  already  noted,  plurality  voting  elevates  the  fourth  place 
majority  candidate  to  second  place  and  drops  the  runner-up  to  fourth  place. 


The  information  on  individual  voters  provided  by  the  experimental  setup 
makes  it  possible  to  understand  what  has  happened.  B  clearly  has  wide  support. 
Beyond  that  a  cohesive  minority  has  voted  for  A  and  elected  A  by  plurality  vote. 
However,  when  the  electorate  is  given  an  opportunity  to  express  its  preferences  by 
removing  the  two-vote  constraint,  many  more  approve  of  C  and  D  than  A.  For 
example,  23%  of  those  not  voting  for  C  on  the  official  ballot  approved  of  C. 
Similarly,  20%  not  voting  for  D  approved  of  D.  But  only  14%  of  those  not  voting 
for  A  approved  of  A. 
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E3  with  its  five  candidates  and  two  positions  is  an  at-largc  election.  Given 
the  freedom  of  approval  voting,  the  electorate  picks  C,  who  has  broad  acceptance, 
rather  than  A,  who  is  favored  by  the  cohesive  minority.  However,  this  is  not  a 
fluke  of  bland  approval,  since  the  rankings  show  that  A  would  lose  in  a  head-to- 
head  election  with  C  (and  even  with  D).  Thus  the  experiment  demonstrates  the 
proposition  that  approval  voting  tends  to  pick  majority  candidates.  Some  people 
may  feel  that  the  cohesive  group  should  win  in  this  situation,  perhaps  believing 
that,  with  two  to  be  elected,  such  a  group  should  have  representation.  This, 
however,  is  a  separate  issue  (to  be  brought  up  later).  By  the  criterion  of  the 
wishes  of  the  electorate  as  a  whole,  approval  voting  has  selected  the  right 
candidates. 

6.    DISTRIBUTION  OF  APPROVAL  VOTES 

One  question  about  approval  voting  is:  how  many  candidates  will  people 
actually  vote  for?  Restrospective  analyses  can  sometimes  infer  preferences  but  are 
unable  to  assert  whether  these  would  have  been  expressed  as  approval  votes. 
Another  question  is  whether  people  will  vote  effectively.  Brams  and  Fishburn  (1983) 
show  that  votes  for  either  one  or  two  candidates  in  a  three-candidate  election  are 
about  equally  efficacious,  i.e.,  have  about  the  same  chance  of  affecting  the  outcome. 
It  is  instructive  therefore  to  examine  the  distribution  of  the  number  of  approvals  in 
elections  El  and  E2: 


El  E2 

1  approval:  660  (46%)  720  (55%) 

2  approvals:         706(49%)  418(32%) 

3  approvals:  69  (  5%)  161  (12%) 
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We  see  that  the  great  majority  of  voters  vote  for  either  one  or  two,  the 
theoretically  effective  strategies.  Less  predictably,  we  find  roughly  equal  numbers 
of    each.  More    surprising    is    the    number    who    approve    of    three,    since    three 

approvals  have  the  same  effect  on  the  outcome  of  the  election  as  not  voting. 
However,  three  approvals  do  indicate  that  all  the  candidates  arc  acceptable  to  the 
voter  as  individuals  to  perform  the  functions  of  the  office.  Another  interesting 
feature  is  that  in  El,  where  approval  voting  produces  a  reversal  of  outcome,  there 
are  more  double  approvals  and  fewer  triples.  This  may  reflect  the  closeness  of  two 
of  the  candidates  and  the  remoteness  of  the  third  for  most  voters. 

Brams  and  Fishburn  (1983)  further  suggest  that,  under  certain  assumptions  of 
the  distribution  of  preferences  in  the  electorate,  when  the  number  of  candidates  is 
four  or  more,  it  is  efficacious  to  vote  for  about  half  of  them.  In  this  light  we 
examine  the  distributions  of  approvals  for  E3,  in  which  two  candidates  are  to  be 
picked  from  five: 

E3 

1  approval:  116    (  8%) 

2  approvals:  641    (46%) 

3  approvals:  494    (36%) 

4  approvals:  75    (  5%) 

5  approvals:  54    (  4%). 

Thus  most  voters  appear  to  be  using  the  leverage  of  approval  voting  effectively. 
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7.    CONCLUSIONS 

What  does  the  TIMS  experiment  say  about  approval  voting  as  a  method? 

Approval  voting  makes  a  difference.  In  the  experimental  contests,  the 
outcome  would  have  changed  for  two  of  the  four  positions  filled.  Although  the  test 
obviously  has  limited  scope,  the  number  of  reversals  is  a  little  surprising.  Most 
analyzed  historical  elections  have  been  selected  because  they  contain  conspicuous 
reversals  of  presumed  popular  sentiment.  Our  examples  are  more  ordinary,  created 
only  to  have  enough  candidates  so  that  the  voting  method  might  make  a  difference. 

The      experimental      data      tell      us      why.  Interestingly,     neither     of     the 

experimentally  found  switches  is  of  the  type  for  which  approval  voting  has  received 
most  of  its  publicity,  i.e.,  two  popular  candidates  splitting  a  majority  so  that  a 
minority  candidate  wins.  Nevertheless,  in  both  of  our  cases  we  can  demonstrate 
that  the  approval  voting  winner  has  broader  support  among  the  electorate  than  the 
plurality  winner.  In  election  El,  the  ranking  data  show  two  candidates  in  a  virtual 
tie.  Approval  voting  breaks  the  tie  because  it  collects  more  data  on  voter 
preferences,  essentially  second  choice  information.  In  election  E3,  approval  voting 
would  switch  the  winner  to  a  majority  candidate  who  would  win  in  one-on-one 
contests  with  each  of  the  relevant  candidates. 

Even  election  E2,  for  which  plurality  and  approval  results  agree,  provides,  on 
deeper  analysis,  a  case  for  the  ability  of  approval  voting  to  identify  the  candidate 
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with  the  broadest  support.  Rankings  indicate  that,  in  a  head-to-hcad  election,  the 
winner  would  have  been  virtually  tied  with  the  runner-up.  In  the  actual  plurality 
election,  the  third  candidate  is  a  spoiler  who  takes  enough  votes  away  from  the 
runner-up  to  create  the  winner.  This  situation  leaves  one  a  little  uncomfortable 
about  fairness.  The  approval  election  would  break  the  tie  on  a  different  basis,  one 
that  seems  more  satisfactory.  The  population  as  a  whole  gives  the  winner  more 
approval  votes  than  the  runner-up,  the  deciding  factor  being  second-choice  votes. 

Approval  voting  is  feasible,  at  least  for  the  members  of  TIMS,  a  professional 
society.  Approval  voting  is,  in  fact,  operationally  simpler  than  some  of  the  voting 
schemes  operating  in  major  cities  today.  In  the  experiment,  no  special  problems 
were  encountered.    Voter  inconsistencies  were  extremely  few. 

Most,  but  not  all,  voters  act  effectivelv.  Theoretical  arguments  suggest 
that,  in  a  three  candidate  race  for  one  postion,  voting  for  exactly  one  or  exactly 
two  candidates  is  efficacious  and  that,  in  a  race  with  many  candidates,  voting  for 
about  half  offers  the  most  influence  to  the  voter.  The  distribution  of  numbers  of 
votes  in  the  experimental  elections  suggests  that  most  of  the  voters  behave  in  these 
ways.  Somewhat  surprising  is  the  number  of  voters  who  approve  of  all  candidates 
(5%,  12%,  and  4%,  respectively,  in  the  three  races).  This  behavior  is  interpreted  as 
meaning  that  all  the  candidates  are  acceptable  to  the  voter. 

The  discussion  so  far  has  focused  on  whether  approval  voting  better  reveals 
the  desires  of  the  electorate  than  plurality  voting,  and  the  experimental  evidence 
has  said  it  does.  However,  other  questions  have  been  raised  about  the  method. 
Critics   have   suggested    that    approval    voting   could    be    deleterious   to   the    two-party 

20 


system  and  that  it  might  be  vulnerable  to  strategic  voting.  The  experiment 
obviously  is  silent  on  the  first  question  and,  beyond  the  rather  interesting 
distributions  of  actual  approval  votes,  seems  to  offer  little  on  the  second. 

A  further  concern  is  that  perhaps  in  some  cases  the  majority  wishes  should 
not  prevail.  Perhaps  a  minority  candidate  should  be  able  to  take  advantage  of  a 
situation  when  two  popular  candidates  split  a  majority.  This,  of  course,  is  not  an 
experimental  issue  but  one  of  criterion.  In  the  same  genre  is  the  situation  that 
came  up  in  election  E3  with  the  five  candidates  for  two  offices.  The  plurality 
winners  were  candidates  B  and  A  but  the  majority  candidates  were  B  and  C. 
Candidate  A  wins  the  plurality  vote  because  of  a  tight  group  of  supporters.  When 
the  electorate  at  large  can  cast  more  than  two  votes,  it  chooses  C.  One  may  argue 
that  the  small  group  who  wanted  A  should  have  representation  even  though  A  would 
lose  to  C  in  a  head-to-head  contest.  Again  this  is  a  criterion  question.  The 
experiment     only     exposes     the     phenomenon.  One     response     would     be     that 

representation  can  and  perhaps  should  be  handled  in  the  design  of  the  election,  not 
the  voting  process.  If  representation  is  desired,  groups  can  be  divided 
geographically  or  by  other  relevant  segmentation  into  separate  elections.  Within 
each  election  the  voting  process  can  be  made  as  broadly  based  as  possible. 

In  summary,  the  experiment  provides  direct  evidence  that  approval  voting 
obtains  more  information  from  the  voter  and  uses  it  to  capture  the  central  tendency 
of  the  electorate  better  than  plurality  voting.  The  approval  method  does  this  about 
as  well  as  ranking  methods  but  with  much  less  effort  on  the  part  of  the  voter  and 
the  tabulator.  Unlike  many  new  or  rediscovered  voting  schemes,  approval  voting 
appears   to  be   an   easily   understood   alternative  to  the   plurality  and  plurality-with- 
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runoff  methods  now  widely  used  for  large-electorate  multicandidate  elections. 
Approval  voting  could  therefore  save  much  public  and  private  expense,  as  well  as 
time,  in  those  cases  where  runoffs  are  now  required. 
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APPENDIX 

We  provide  here  further  data  to  support  and  enrich  the  analyses  in  the  text, 
especially  for  elections  El  and  E3. 

Ballot  transcription  and  discrepancies 

The  TIMS  Business  Office  transcribed  the  official  ballot  votes  onto  the  test 
ballot  for  each  voter  who  returned  both  to  provide  consistency  checks  and  to  link 
the  two  ballots.  A  few  minor  discrepancies  arose  from  transcription.  For  example, 
the  official  plurality  votes  in  El  for  A,  B  and  C  are  166,  827  and  835  respectively 
(Table  1).  The  same  counts  from  the  transcriptions  on  the  test  ballots  are  167,  826 
and  835  respectively  (see  Table  7  "official  plurality  vote").  None  of  the 
discrepancies  affects  our  conclusions. 

Several  interesting  inconsistencies  occurred  in  the  voting.  Nine  voters  in 
election  E3  approved  of  a  candidate  ranked  lower  than  one  they  did  not  approve  of. 
Two  El  voters  did  not  approve  of  their  official  ballot  choice,  yet  approved  of  some 
other  candidate.  Seven  voters  did  the  same  in  E2.  In  the  five-candidate  E3 
election,  18  voters  failed  to  approve  of  a  candidate  selected  on  their  official  ballot 
yet  approved  others  not  selected  on  the  official  ballot. 

Rankings 

In  election  El,  95%  of  the  voters  who  ranked  one  or  more  candidates  on  the 
test  ballot  ranked  all  three  (1415  of  1484).  In  E2  it  was  88%  (1161  of  1313).  In 
E3,  1420  voters  ranked  the  candidates,  of  whom  46  ranked  onlv  their  first  choice, 
210  ranked  their  first  two  choices,  189  ranked  three,  and  975  (64"/..)  ranked  all  five. 
A  few  voters  indicated  ties  in  their  rankings. 
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Approval  voting.  El 

Tabic  7  shows  the  match-ups  between  approval  votes  and  official  plurality 
votes  along  with  other  data  used  to  obtain  the  summaries  in  Table  1.  The  upper 
part  of  the  tabic  includes  1567  voters  who  returned  a  test  ballot  for  El  along  with 
their  official  ballot  and  shows  the  number  of  voters  who  approved  each  possible 
subset  of  candidates  as  a  function  of  the  voter's  official  ballot  choice.  For 
example,  of  the  105  voters  who  approved  of  A  and  C,  24  voted  for  A  on  the  official 
ballot,  none  voted  for  B,  79  voted  for  C,  and  two  voted  for  nobody.  The  "actual 
approval  vote"  column  in  Table  1  is  obtained  from  the  totals  column  in  the  upper 
part  of  Table  7. 

The  middle  part  of  Table  7  summarizes  the  number  of  approval  votes  for 
each  candidate  as  a  function  of  the  candidate  voted  for  on  the  official  ballot.  The 
next  two  lines  record  the  test-ballot  nonresponders  who  voted  on  the  official  ballot 
(N^  =  21,  Ng  =  134,  Nc  =  111),  and  the  total  plutality  votes  (counted  from 
transcriptions  on  the  test  ballots  plus  the  nonresponders  totals). 

The  bottom  section  shows  the  calculation  for  extrapolated  approval  vote 
totals. 

Approval  voting.  E2 

Table  8  does  for  election  E2  what  Table  7  does  for  El. 
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TABLE  7 

Number  of  voters  approving  each  possible  subset  of 

candidates,  broken  out  by  voter's  official  choice, 

plus  various  summaries  and  extrapolations. 

Election  El 


Candidates  in 

approval  set  Total 

(R2  +  R3)  ABC  none  ballots 


none 

4 

18 

46 

0 

68 

A 

66 

0 

0 

0 

66 

B 

2 

345 

1 

2 

350 

C 

0 

0 

289 

1 

290 

AB 

41 

133 

1 

0 

175 

AC 

24 

0 

79 

2 

105 

BC 

0 

174 

268 

0 

442 

ABC 

9 

22 

40 

_0 

71 

Subtotals 

146 

692 

724 

5 

1567 

Approval  votes 

for: 

Actual 
approval 
vote  (sum) 

A 

140 

155 

120 

2 

417 

B 

52 

674 

310 

2 

1038 

C 

33 

196 

676 

3 

908 

Other  official 

votes  (Rl): 

21 

134 

111 

266 

Official  plural] 

ity 

vote: 

167 

826 

835 

1828 

Extrapolated  additions 

to  approval  vote  for:  Extrapolated 

approval 
vote  total 
A  21(140/146)  +  134(155/692)  +  111(120/724)  =  69  486 

B  21(52/146)    +  134(674/692)  +  111(310/724)  =  186  1224 

C  21(33/146)    +  134(196/692)  +  111(676/724)  =  1465  1054 
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TABLE  8 

Number  of  voters  approving  each  possible  subset  of 

candidates,  broken  out  by  voter's  official  choice, 

plus  various  summaries  and  extrapolations. 

Election  E2 


Candidates  in  Voter's  choice  on  official  ballot 

approval  set  Total 

(R2+R3)  ABC  none  ballots 


none 

15 

28 

35 

0 

78 

A 

194 

2 

0 

3 

199 

B 

0 

245 

0 

3 

248 

C 

1 

3 

263 

6 

273 

AB 

37 

46 

0 

1 

84 

AC 

44 

1 

69 

0 

114 

BC 

0 

119 

99 

2 

220 

ABC 

45 

49 

59 

^ 

161 

Subtotals 

336 

493 

525 

23 

1377 

Approval  votes  fc 

»r: 

Actual 
approval 
vote  (sum) 

A 

320 

98 

128 

12 

558 

B 

82 

459 

158 

14 

713 

C 

90 

172 

490 

16 

768 

Other  offical 

votes  (Rl) 

50 

58 

74 

182 

Offical  plurality 

votes 

386 

551 

599 

1536 

Extrapolated  additions  Extrapolated 

to  approval  vote  for:  approval 

vote  total 
A  50(320/336)  +  58(98/493)  +  74(128/525)  =  77  635 

B  50(82/336)    +  58(459/493)+  74(158/525)  =  88  801 

C  50(90/336)    +  58(172/493)+  74(490/525)  =  103  871 
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Approval  voting.  E3 

Table  9  shows  the  number  of  voters  approving  each  subset  of  candidates  as  a 
function  of  the  candidate  pairs  they  chose  on  the  official  ballot.  For  example,  row- 
ABC  shows  that,  of  60  people  who  approved  of  A,B,and  C,  23  voted  for  A  and  B  on 
the  official  ballot,  20  voted  for  A  and  C,  16  voted  for  B  and  C,  and  one  person 
voted  for  C  and  E.  Contrary  to  instruction  on  the  official  ballot,  a  number  of 
people  voted  for  only  one  of  the  five  candidates  on  that  ballot.  These  votes  were 
counted  in  the  official  totals  but  are  not  reflected  in  Table  9. 

Summaries  of  the  data  in  the  main  table  are  given  at  the  bottom. 
Conditional  relative  frequencies  for  approving  of  a  candidate  not  on  the  official 
ballot  pair  can  be  computed  from  the  table.  For  example,  of  the  255  voters  who 
voted  for  B  and  C  on  the  main  ballot,  29  approved  of  A  (11%),  57  approved  of  D 
(22%),  and  53  approved  of  E  (21%).  As  noted  in  Section  5,  14%  of  the  voters  who 
did  not  vote  for  A  approved  of  A,  23%  who  did  not  vote  for  C  approved  of  C,  and 
20%  who  did  not  vote  for  D  approved  of  D. 


28 


TABLE  9:       Number  of   voters  approving  each  subset  of  candidates,  broken  out  by 
voter's  choice  pair  on  the  official  ballot.    Election  E3. 


Candidates 

Voter's  ch( 

3ice  pair  on  off 

icial  ballot 

approved 

AB 

AC 

AD     AE 

BC 

BD 

BE 

CD 

CE 

DE 

Total 

of        A 

6 

2 

1 

9 

B 

5 

7 

4 

2 

18 

C 

2 

2 

4 

3 

11 

D 

1 

4 

2 

7 

E 

2 

1 

3 

_6 

1  a.v.^ 

=51 

AB 

99 

1 

1 

1 

102 

AC 

34 

34 

AD 

1 

67          1 

69 

AE 

1       46 

47 

BC 

137 

1 

1 

139 

BD 

83 

83 

BE 

1 

47 

48 

CD 

1 

1 

2 

63 

1 

68 

CE 

31 

31 

DE 

24 

24 

2  a.v. 

=645 

ABC 

23 

20 

16 

1 

60 

ABD 

30 

22 

12 

64 

ABE 

28 

24 

14 

66 

ACD 

8 

15 

1 

8 

1 

33 

ACE 

I 

7 

9 

1 

18 

ADE 

18         7 

7 

32 

BCD 

38 

35 

32 

105 

BCE 

31 

17 

1 

13 

62 

BDE 

14 

10 

5 

29 

CDE 

5 

2 

-^ 

^ 

9 

3  a.v. 

=478 

ABCD 

8 

4 

3 

3 

2 

20 

ABCE 

3 

1 

3 

3 

2 

12 

ABDE 

2 

2       2 

2 

1 

9 

ACDE 

2       2 

4 

BCDE 

9 

6 

5 

2 

4 

1 

27 

4  a.v. 

=72 

ABCDE 

6 

1 

9       3 

9 

10 

3 

8 

1 

50 

5  a.v. 

=50 

Total: 

212 

80 

142     99 

255 

174 

102 

129 

57 

46 

1296 

official  ballot 

ballots  wi 

th 

count  above 

approva 

a 

A 

533 

629 

B 

743 

894 

C 

521 

683 

D 

491 

633 

E 

304 
2592 

474 
3313 

(=2x1296) 

(=51 

+2x645+3x 

478+4: 

x72+5x 

50) 

29 
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